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ABSTRACT: 

A network video server apparatus and method for transferring video image data across a 
computer network serving multiple clients. The network server apparatus comprises two parts, a 
server and a client. The server is run on a computer system containing a video digitizer hardware. 
Running the sen/er on this computer system makes it possible to distribute video images across 
an existing network linking several client computer systems. The client provides the user with a 
means of viewing the images generated by the server through the network, controlling the size 
and type of image to be sent by the sen/er, controlling the underlying video digitizer hardware, 
and collecting statistics about the sen/er/client performance. The client software is designed to 
appear to the users as if they were operating the client software locally. The server and client 
communicate with each other over two channels: one for control information and another for 
video data. Data transfer from a server to a client is asynchronous such that the server need not 
wait for a client to complete its receipt before servicing the next client. 
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@ A network video server apparatus and method 
for transfening video image data across a conv 
puter networic serving multiple clients. The net- 
work server apparatus comprises two parts, a 
server and a dient The server is run on a 
computer system containing a video digitizer 
hardware. Running the server on this computer 
system makes it possible to distribute video 
images across an existing network linking sev- 
eral client computer systems. The client pro- 
vides the user with a means of viewing the 
images generated by the server through the 
network, controlling the size and type of image 
to be sent by the server, controlling the underly- 
ing video digitizer hardware, and collecting 
statistics about the server/client performance. 
The client software is designed to appear to the 
users as rf they were operating the client 
software locally. The server and client oonv 
municate with each other over two channels: 
one for control infomnation and another for 
video data. Data transfer from a server to a 
client Is asynchronous such that the server 
need not wait for a client to complete its receipt 
before servicing the next client. 



Server 
-200- 



CO MPUTER 



wiinlVlDEO DIGI' 



Cien] 1 
'290- 



r 



UBfWtY IMTERFACE SYSTEM 
-23P- I -215- 



COMPUTER 
-210- 



Pfotocol oommunicalion 
back to the $«rv9r. 



P UN aichftaaufe] 



Clienl2 -290- 
Identica] configuration to Client 1 
using Ihg same Protocol bach 
to the servei. 



Cli»nt I -290- 
Uanticd configuraflon to CSonl 1 
usng ths taire Protcxnl back 
to the server 



Clients -290- 
Identical configuraiion to Client 1 
using the same Protocol back 
to the server 



Figure 2 



CL 

m 



Jouve, 18, rue Saint-Denis, 75001 PARIS 



EP 0 529 864 A1 



BACKGROUND OF THE INVENTION 

1. FIELD OF THE INVENTION: 

5 The present invention relates to transferring data across a computer network, and more particularly, to 
transferring video image data from a computer running a server process through a computer network to mul- 
tiple computers running a client process on an Independent basis. 

2. ART BACKGROUND: 

10 

With the advent of computer and video technologies, It is moreand more common to integrate video images 
into a computer system, such as a workstation or a desktop personal computer, for uses in desktop publishing 
and multimedia application. Such a system typically consists of a computer with a high performance central 
processing unit (CPU), a high resolution display system, a video processor, high capacity memory and a video 
15 digitizer. The captured video image source may come from a video digitizer, a video frame grabber, or a video 
encoder/decoder. In a low end video application, a digitizer allows a user to import images from a video camera 
or VCR, and display or save t he images on a computer. Alimitation of the digitizer entry is that it usually requires 
several seconds to capture an image, which makes working with moving subjects, or continuous images, im- 
practicable. In a higher end of technology, a video frame grabber allows a user to capture a single video frame 
20 in about 1/30 of a second thus providing much higher bandwidth in yideo capturing. The captured video frame 
'Z is doh'y^^^ format suitable fort he computer's processor. With the proliferation of computer neb^vork 

iystemsrit becomes quite bonnnrion and desirable for individual computere to transfer and receive video images 
7acrpss:a nel^ ' 

An example of a vWeo acquisition device is the videoPix™ card, manufactured by Sun Microsystems, Inc., 
25 Mountain View, Ca., which allows users to capture, manipulate, store, and share images. Particularly, when 
a video digitizer card is connected to a SPARCstation™ system, a user can easily capture 8- or 24-blt color or 
grayscale images and integrate the images into applications such as desktop publishing or multimedia elec- 
tronic mail. 

In an environment of networked computers and peripherals, it is common to pool peripherals, such as I/O 

30 devices, printers and offline memory storage for use by each networked computer. In such case, the peripheral 
called on is referred to as a server and the calling computer is referred to as the client. Also, it is common for 
a computer to act as a server for other clients when data in the server needs to be accessed by the clients. 
In computer network parlance, a "server" is a piece of software and/or hardware through which network ser- 
vices are implemented. A "network service" is a collection of one of more remote programs. Usually, a remote 

35 program implements one or more remote procedures; the procedures, their parameters, and results are docu- 
mented in the specific program's protocol specification, in order to access services through the network, net- 
work clients issue remote procedure calls (RFC) to initiate the services. A server may support more than one 
version of a remote program in order to be forward compatible with changing protocols. For example, a network 
file service may be composed of two programs. One program may deal with high-level applications such as 

40 ale system access control and locking. The other may deal with low-level file I/O and have procedures such 
as "read" and Vrite." A client of the network file service would call the procedures associated with the two 
programs of the service on behalf of a user on the client computer. 

The remote procedure call (RPC) model used by the client to access the server across the network is sim- 
ilar to the local procedure call model, in the local procedure call model, the client caller places arguments to 

45 a procedure in some well-specified location (such as a result register). The client then transfers control to the 
procedure, and eventually gains back control. At that point, the results of the procedure are extracted from the 
well-specified location, and the caller continues execution. Referring to Figure 1, the RPC is similar in that 
one thread of control logically winds through two processes- one is the caller's process, the other is the ser- 
ver's process. That is, the caller process sends a call message to the server process and waits for a reply mes- 

50 sage. The call message contains the procedure's results, among other things. Once the reply message is re- 
ceived, the results of the procedure are extracted, and the client caller's own operation is resumed. On the 
server side, a process is dormant awaiting the arrival of a call message. When one arrives, the server process 
extracts the procedure's parameters, executes the procedure requested, sends a reply message, including the 
results of executing the procedure. Note that in this illustrative RPC model, only one of the processes is active 

55 at any given time. However, the RPC protocol makes no restrictions on the concurrency model implemented, 
and others are possible. For example, an implementation may choose to have RPC calls be asynchronous so 
that the client may perform useful work while waiting for the reply from the server. Another possibility is to 
have the server create a task to process an incoming request, so that the server can be free to receive other 
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requests. For more discussion on RPC's, see, for example, Network Programming, available from Sun Micro- 
systems, inc., Mountain View, California. 

When the server needs to transfer large quantities of continuous data to clients across a computer network, 
as in the case of broadcasting video image data from the server to clients acrossthe network, the command/re- 
5 sponse-oriented RPC has its limitations. First of all, digital video data is grabbed from the video data source 
and continuously transferred across the network to any computer accessing the server, as opposed to data 
in discrete data files transferred by RPC's. In a network environment, it is also desirable to have optinnization 
processing to achieve efficiency - an area in which the RPC is deficient. The point-to-point communication 
created by the RPC cannot not allow sharing of network resources among the multiple clients across the net- 
to work. For example, if another client makes the same request as the previous client, e.g. requesting the same 
frame of video data by the same format, separate RPCs cannot provide for caching t he already formatted data 
to save processing time. Further, the traditional RPC mode! cannot support multiple clients each communi- 
cating with the server on an independent basis, which enables each client to receive data In its desired format 
irrespective of other clients' desired formats. 
15 The present invention provides for a network video server for transferring video image data across a com- 
puter network to a plurality of clients, where each client can communicate with the server independently, and 
efficiently. As described, the present invention also achieves optimization by allowing network resources to 
be shared concurrently among multiple clients. 

20 SUMMARY OF THE INVENTION 

Therefore, it is an object of the present invention to efficiently transfer video image data across a net- 
worked computer environment. 

It is also an object of the present invention to allow networked computer stations to share captured video 
25 image data with nninimum degradatian of network performance and without the cost of private video capture 
hardware. 

It is also an object of the present invention to provide the network server with'the ability to support multiple 
clients of the video service, across the network, independently. 

The network video server incorporating the presently claimed invention comprises two parts, a server and 

30 a client. The server process is run on a computer system coupled to a video digitizer. The video digitizer accepts 
video data as its input and provides digital data representative of an analog frame of video data as its output 
to the computer. By running the server process with the computer system it is possible to distribute digital video 
images produced by the vkieo digitizer across an existing network to several computer systems running in- 
stances of the client process. The client process provides the user with a means of viewing the images gen- 

35 erated by the video digitizer through the network, controlling the size and type of image to be sent by the server 
process, controlling the underlying video digitizer, and conecling statistics about the server/client perfor- 
mance. 

A multiple channel communication system between the server and the clients provides the bandwidth 
needed to effectively transfer the digital video data. The server and each client communicate through two chan- 
40 nels: one for control information and anot her for video data. Data transfer from the server to t he client is asyn- 
chronous such that the server need not wait for a client to complete receipt of the video data before servicing 
the next client, thus providing the capability for a single video digitizer to service multiple clients concurrently. 

BRIEF DESCRIPTION OF THE DRAWINGS 

45 

The objects, features and advantages of the present invention will be apparent from the following detailed 
description in which: 

FIGURE 1 is a diagram illustrating a Remote Procedural Call paradigm in the prior art. 

FIGURE 2 is a block diagram representation of the presently preferred embodiment. 
50 FIGURE 3 is a flow chart illustrating the server initialization process. 

FIGURE 4 is a diagram illustrating the process of connecting a client to the server 

FIGURE 5 is a flow chart diagramming the main loop of the Network Video Server. 

FIGURE 6 is a flow chart diagramming the process of getting video data for a channel by the server. 

FIGURE 7 is a block representation of data transfer among a server and multiple clients. 
55 FIGURE 8 is a schematic diagram of the muiti-threaded video server application. 
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DESCRIPTION OF THE INVENTION 

1. Notation And Nomenclature 

5 The detailed descriptions wiiich follow are presented largely in terms of algorithms and symbolic repre- 
sentations of operations on data bits within a computer memory. These algorithmic descriptions and repre- 
sentations are the means used by those skilled in the data processing arts to most effectively convey the sub- 
stance of their work to others skilled in the art. 

An algorithm Is here, and generally, conceived to be a self consistent sequence of steps leading to a desired 

10 result. These steps are those requiring physical manipulations of physical quantities. Usually, though not nec- 
essarily, these quantities take the form of electrical or magnetic signals capable of being stored, transferred, 
combined, compared, and otherwise manipulated. It proves convenient at times, principally for reasons of com- 
mon usage, to refer to these signals as bits, values, elements, symbols, characters, terms, numbers, or the 
like, it should be borne in mind, however, that all of these and similar terms are to be associated with the ap- 

15 propriate physical quantities and are merely convenient labels applied to these quantities. 

Further, the manipulations performed are often referred to in terms, such as adding or comparing, which 
are commonly associated with mental operations performed by a human operator. No such capability of a hu- 
man operator is necessary, or desirable in most cases, in any of the operations described herein which form 
part of the present invention; the operations are machine operations. Useful machines for performing the op- 

20 erationsof the present invention include general purpose digital computers or other similar devices, in all cases 
there should be borne in mind the distinction between the method operations in operating a computer and 
the method of computation itself. The present invent! on relates to method steps for operating a computer in 
processing electrical or other (e.g., mechanical, chemical) physical signals to generate other desired physical 
signals. 

25 The present Invention also relates to apparatus for performing these operations. This apparatus may be 
specially constructed for the required purposes or it may comprise a general purpose computer as selectively 
activated or reconfigured by a computer program stored in the computer. The algorithms presented herein are 
not inherently related to a particular computer or other apparatus, in particular, various general purpose ma- 
chines may be used with programs written in accordance with the teachings herein, or it may prove more con- 

30 venient to construct more specialized apparatus to perform the required method steps. The required structure 
for a variety of these machines will appear from the description given below. 

2. Coding Details 

35 No particular programming language has been indicated for carrying out the various procedures described 
herein. This Is in part due to the fact that not all languages that might be mentioned are universally available. 
Each user of a particular computer will be aware of a language which is most suitable for his immediate pur- 
poses, in practice, it has proven useful to substantially implement the present invention in an assembly lan- 
guage which provides a machine executable object code. Because the computers and the monitor systems 

40 which may be used in practicing the instant invention consist of many diverse elements, no detailed program 
listing has been provided. It is considered that the operations and other procedures described herein and il- 
lustrated in the accompanying drawings are sufficiently disclosed to permit one of ordinary skill to practice 
the Instant invention. 

45 3. General Description 

The following general system description discloses the current configuration in conjunction with the pre- 
sently claimed invention. However, it will be apparent to those skilled in the art that the presently claimed in- 
vention can be practiced without the specifics of the current configuration. As such, the general system de- 

50 scribed hereinafter is for illustration purposes only. Also, although the description makes references to the 
Unix® operating system and channel utilities, it will be apparent to those skilled in the art that any other op- 
erating systenns with utilities similar to the point-to-point network channel communication can be used to ach- 
ieve the desired functionality of the presently claimed invention. Figure 2 illustrates the general system. The 
server process 240 is run on a computer 210 containing the video digitizer 220. The server 200 and clients 

55 290 are networked through a local area network 235. The interface system 215 of client 1 290 controls the 
display and execution of processes and controls the display of images on the computer 210 running the client 
process 250. The video digitizer 220 provides the computer system 210 with the capability to digitize images 
from composite video signals. The video digitizer 220 decodes the composite video signal into digital data rep- 
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resenting various luminance and chrominance components. 

A library 230 is used in conjunction with computers 210 to process digital video data and to provide users 
with utilities to convert the decoded image data into formats and sizes suitable for image display on computers 
210. The video digitizer 220 currently is capable of supplying the user with digital color images in YUV format. 
5 The library 230 currently converts the YUV data into such formats as 24-bit color BGR, 8-bit color and 7-bit 
grayscale data. Additionally, images can be saved as 24-bit files, 8-bit color, 7-bit gray scale and 1-bit mono- 
chrome. 

A method and apparatus for transferring digital video data across a computer network between a server 
and a plurality of clients is disclosed. When the server process is initialized, it establishes connection with a 

10 video digitizer as its input source. After the server establishes a first communication channel for the Initial com- 
munication with the clients, the server enters into a dormant state awaiting linking requests from the clients. 

Aclient connects to the server by transmitting an initial linking request tothe server through an initial, well- 
known, communication channel. Upon receiving the linking request, the server establishes a new control chan- 
nel with the client and sends the channel identification to the client through the new control channel. Upon 

15 receiving the identification from the server, the client establishes a data channel with the server and sends 
the channel Identification to the server through the data channel. The server then clears the data channel 
and sends an acknowledgement to the cllentthrough the control channel. The server and client are synchron- 
ized when the client receives the acknowledgement from the server. 

In sending digital video image data to a single client connected to the network, the server grabs images 

20 directly from the video digitizer and writes directly to the client across the network. In a case with multiple 
clients requesting various formats of data, the server grabs the image from the video digitizer and stores it in , 
a local memory, from wh ich it can derive various formats throug h the library before writing to each client Image 
buffers are set up by the server to store already derived fornrtats so that if another client requests the same 
format of image, the server can prepare the data for the requested format because it is already available in 

25 the image buffer, thus avoiding delay and minimizing duplicate hardware activity. Furthermore, because of 
the multiple channel communication, the write from the server to each client can be asynchronous so that the 
server can attend to other clients before a write to one client is completed, thus optimimizing the write oper- 
ation. 

Reference is now made to Figure 2. The network video server employing the presently claimed invention 

30 comprises two parts, a server 200 and a client 290 . The server process 240 is run on a computer 21 0 containing 
the video digitizer 220. By running the server 240 on the computer 210, digital video images can be distributed 
across an existing network. The client 290 provides the user of computer 21 0 with means of viewing the images 
transferred from the server 200, controlling the size and type of image that the server 200 sends to it, con- 
trolling the underlying video digitizer 220, and collecting statistics about the server/client performance. Once 

35 the client 290 is connected to the server 200, the client program 250 operates from the user's perspective as 
if the digitizer hardware was coupled locally to the client 290. 

The server and client communicate with each other through two communication channels. One for control 
information and another for video data. Commands are communicated over the control channel. The data chan- 
nel is used for sending image data. Having two separate channels for commands and video data provides for 

40 increased data transfer capabilities, particularly when video image data are to be transferred in high volume 
and in high speed. The use of two channels also helps prevent race conditions from occurring between the 
server and client Currently, TCP (Transmission Control Protocol) channels are used by the server to commu- 
nicate with each client because of TCP's accuracy and reliability in data transfer. Commands from the client 
to the server are in the format given in two types of structures, one for the initial connection to the server and 

45 one for all other commands. The initial command is different in that it passes the client users log-in name to 
the server so that it can be sent to the other clients by the server 

An example of a command is a PREVIEW mode (SET_VIDEO_MODE) setting the various sizes, color and 
grayscale. For the PREVIEW mode, there is no data associated with the command. However, If the command 
were to SWITCH video-in ports, since the video digitizer hardware may have multiple video-in ports, then the 

so number of the port would be the data associated with the command. The following are a list of curent com- 
mands which may be used in the preferred embodiment of the present invention. 
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5 


Command 


Function 






v/OnnBCi a n©w 
Client to the 
server. 


10 


onurUUWN 


bnutuown ine 
server. 


15 


DISCONNECT 


Disconnect a 
ciieni from the 
server 


20 


GET^FRAMEINFO 


Get information 
frame. 


GET_STATUS 


Get status 
Information from 
ine server. 


25 


SET/GET_MODE 


Sel/get the 
current mode of 
the video stream. 


30 


STREAm_START 


Start the video 
stream flow from 
the server to the 
client. 


35 


<%TRPAM QTDP 
O 1 nci/\ivi_o 1 \Jr 


Qt nn fKa ulrlan 
OiUp iriB Viu90 

Stream flow. 




GET_CUP 


Get a dip of N 
frames of video. 


40 


SET/GET_HW 


Get/sel the cunent 
value of the 
cun^ent server 
hardware. 



45 Table 1 

Afler each command has been sent to the server the client awaits a response. The response received 
varies from command to command. The response from the server is also defined as a C data structure aithough 

50 it only contains one element. This provides expandability without major programming effort. 

Reference is now made to Figure 3, where the process for video server initialization is diagramnned. Cur- 
rently the video server is started at the UNIX® shell command line by entering the name of the server program. 
Although the server process is initiated by the user as shown in Figure 3, it will be obvious to those skilled in 
the art that other process initiations are also available. Once started 310, after initialization of variables and 

55 parsing the command line 320 by the server, the video digitizer device Is opened for reading by the server. 
Currently, if another process, such as an application, has already opened the video digitizer hardware, access 
to the digitizer hardware through the server will be refused and the program will terminate 330. However, it 
should be apparent to those skilled in the art that the video digitizer hardware can be a non-exclusive device 



6 



EP 0 529 864 A1 

to accommodate concurrent accessing by various processes. If the digitizer is opened successfully tlie video- 
in ports are interrogated for the presence of a valid video signal by the server. On the first port with a valid 
video signal the scanning is aborted and that port is used as the input video source. The format of the video 
signal is determined (NTSC or PAL) and the digitizer is set up according to the format 340. 

5 After the video digitizer Is opened, the network connections are established. Afirst channel, serving as a 
default channel, is opened for initialization before the server enters Into a loop awaiting activity on the first 
channel 360 as will be described in connection with Figure 5. Under the current UNIX® system, processes 
communicate using the client-server model: a server process systems to a channel, one end point of a two- 
way communications path, and client processes communicate to the server process through another channel, 

10 the other end point of the communications path. For those clients wishing to establish a connection with the 
server, communication is initially through the default channel, as this default channel is well-known to all the 
clients throughout the network. For further discussion on the channel mechanism, see, for example, The De- 
sign of the UNIX® Operating System by Maurice J. Bach, published by Prent Ice-Hal I, Inc. 

Reference is now made to Figure 4, where the process flow of connecting a client to the server is shown. 

15 The client process is started on a computer located in a remote location, and on the same network as the ser- 
ver. Preferably the client is run on a computer which provides a graphical user interface (GUI) that allows the 
user to enter the name of the computer running the video server and initiate a connectfon request by clicking 
a cursor control devlce such as a mouse button. The client then attempts to connect to the server through a 
default channel, which Is well-known to the clients. 

20 Upon receiving the request from the client, the server establishes a channel to generate a new private 
connection to the client 410. This private channel becomes the control channel for this client. Upon receiving 
a signal from the server identifying the control channel, the client creates the data channel and sends an iden- 
tifier for the data channel, along with the identification of the client, to the server, through the control channel 
420. The server completes the connection of the data channel and sends an "out of band" (OOB) marker to 

25 clear the data channel 430. Communication on the data channel is established when the server sends the 
client the Identifier of the data channel 440. This establishes bi-directional data flow between the client and 
server through the data channel. At this point the client gets the video format and curent hardware configur- 
ation from the server. The server adds the new client to Its list of connections and allocates memory for Image 
data to be transferred. 

30 Once connected to the clients, the network video server can be described as a muiti-threaded application 
with three layers as illustrated in Figure B. The bottom layer 800 is a single thread which when required, grabs 
an image 801 firom the video digitizer hardware 830. With this one image, multiple threads can generate the 
various formats (815, 816) of displayable images, e.g. a thread for grayscale, a thread for 8-bit color, and a 
thread for 24-bit color. The top layer 820 Is a thread (821, 822, 823) for each client connection using a data 

35 channel and a corresponding control channel. The client specifies the desired fornrmt of image data to the sec- 
ond layer 810. If the YUV data already exists, then the specified type of image is generated from the existing 
YUV data, otherwise the YUV "grab thread" runs before the second layer thread can return to the top layer 
client. 

The following describes the process used to initiate the sending of a stream of video data from the server 

40 to the client, assuming that connection has been successfully made to the server. From the client's point of 
view the operation for starting and stopping a stream of video is the same irrespective of the number of the 
clients connected to the server. On the server's side a distinction is made between a single client and multiple 
clients. With reference to Figure 7, data transfer begins with the client 760 selecting the format of image data 
to be used and to be transferred from the server 700 after the server process 701 extracts the image data 

45 from the video digitizer hardware 720. Image data in the selected format is asynchronously transferred from 
the server process 701 to the client 760 so that the server process 701 may attend to other clients before the 
first client completes its receipt of data. In single-client connection, the server process 701 takes the image 
data directly from the video digitizer hardware 720 and extracts the selected format of image data to be trans- 
ferred to the client. Also, In multiple-client connection with all requested formats being the same, the server 

50 process 701 generates the image directly from the hardware 720. In multiple-client connection with possible 
multiple formats of image data selected, an optimization scheme is used. The server process 701 first stores 
the image data from the digitizer hardware 720 In an intermediary buffer (not shown) allocated by the server 
process 701 , where different formats of image data can be derived subsequently. Also, once a format of image 
data Is generated, this data is marked available so that if the same format is requested by another client, data 

55 can be readily duplicated and transferred to that client. 

An exemplary operation of the current embodiment is described as follows with reference made to Figures 
6 and 7. in the case of single-client connection, the client first tells the server through the SET_MODE com- 
mand which preview format it wishes to use. The following formats are currently available. 
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Format 


Description 


FULL_NTSe_BW 


640M80 Grayscale NTSC Video 


FULL_PAL_BW 


768*575 Grayscale PAL video 


HALF_BW 


360*240 grayscale 


QUARTER_BW 


160*120 grayscale 


FULL_COL 


Square pixel Image 8-bit color 


HALF_COL 


360*240 8-bit color 


QUARTERjCOL 


180*120 8-bit color 


FULL.MONO 


Square pixel image monochrome 


GRAB_YUV 


Grab an image 



The particularformat to be used is selected by the userof the client. Assume FULL_NTSC_BW is selected. 
This means that the client 760 wishes to see a 640*480 grayscale square pixel NTSC image. Having selected 

25 the format the client process 744 tells the server process 701 to Initiate the flow of digital video Images oh 
the data channel. The server 701 first issues an OOB message on the data channel such that the client 744 
can discard all the information on the data channel until the OOB message is detected, which synchronizes 
the server process 701 and client process 744. Since there is only one client 760 the server process 701 grabs 
the image data directly from the video digitizer hardware 720, extracts grayscale data directly from the image 

30 data on the video digitizer 720, and transfers the data to the client 760. 

The client process 744 reads the video images from the data channel and assembles the video lines to 
form a complete Image. As illustrated In Figure 7 where only client 1 760 is connected, the image is stored in 
shared memory 740 before being written to the frame buffer 750 through the window system 755 of the client 
1. Storing the image in shared memory 740 makes the time to transfer the image to the frame buffer 750 sig- 

35 niflcantly faster than using a standard call to perform the operation because shared memory 740 can be ac- 
cessed by both the client 744 and the window system 755. Until the data stream is stopped the client 760 will 
continuously display images from the server 700 as fast as it can receive them. 

Reference is now made to Figure 6, where the process of sending video data to multiple clients is dia- 
grammed. When there are multiple clients connected it is not necessarily true that they will all wish to receive 

40 the same modes of the video image data. In this case the server may read the image data from the video 
digitizer hardware and stores it in a local memory (Figure 7, 770). All formats of the image can be derived 
from this image data in the local memory 770. 

Assuming, for an example, that there are three clients connected to the server, and all have requested 
the server to transfer a stream of video Images. Referring to Figure 6, two of the clients wishes to receive 

45 FULL_NTSC_BW images and the other client wishes to receive QUARTER_BW images. The server first cap- 
tures an image from the Incoming video source (Figure 7, 710) and reads all of the YUV data through the video 
digitizer hardware (Figure 7, 720). For the first client the field NTSC grayscale image is generated from the 
local memory (Figure 7, 770) and the write is started for that client. The image buffer (not shown) written to 
the first client is marked "available" by the server 701 as having been generated for possible future reference. 

50 Using asychronous I/O the server (Figure 7, 701 ) now need not wait for the first write to finish before servicing 
to the next client. Since the second client in the sequence wishes to receive the QUARTER BW image, the 
server (Figure 7, 701 ) scans the previously calculated image buffer and determines that its desired image is 
not available and it must calculate the image from the YUV data before starting the write to the client. For the 
third client in this example the image requested has already been generated and the server can readily write 

55 to contents of the image buffer to the third client. 

SET_HW and GET_HW are two exemplary commands which allow the client to set and get the video digi- 
tizer hardware through the server. Currently there are four variables that can be controlled: which input port 
to use; how to determine the format of the incoming video signal; the value of the hue control; and how to 
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detect the color portion of the incoming video signal. The four current nninor commands are listed below: 
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Command 

HW_PORT 
HW^FORMAT 

HW_HUE 
HW COLMOD 



Function 



Change/get the current Input port 

Change/get the method of delecting 
the formal of the incoming video 
signal. 

Change/get the value of the hue offset 
control from 0. 

Change/get the method of detecting 
the color content of the Incoming 
video signal. 



20 



25 



HW_PORT can have one of three values, which is passed to the server as the value of data In the com- 
mand structure. Currently, the possible values are 1, 2 or 3. "1 " corresponds to the first RCA port, "2" the 
second RCA port, and "3" the S- Video port. HW_FORMAT allows the user to select between auto-detecting 
the video format or forcing it to be NTSC or PAL. The value selected is passed as the value of data. HW_HUE 
adjusts the value of the hue of the video signal from a nominal value. Offsets are in the range -20 to +20 de- 
grees. The adjustment value is passed In the data value. HW_COLMOD determines the manner in which the 
color component of the video signal is to be detected. Three options are available. The option chosen Is passed 
to the server in the data member of the command structure. AUTO asks the software to automatically deter- 
mine the format; COLOR forces the hardwara to look for a color component of the signal; and B&W forces the 
hardware to only detect the black and white (grayscale) component of the incoming video signal. 



30 



Claims 

1. In a data communication system comprising a plurality of computers coupled through a computer network, 
35 video acquisition means coupled to a first computer ("server^ for converting video Image data from a video 

source into digital video data, a method for providing said digital video data to at least one other computer 
("client"), said method comprising the steps of: 

said client requesting active connection with said server by sending a connection request to said 
server through a default communications channel; 
40 upon receipt of said connection request, said server responding by establishing a control channel 

and a data channel dedicated to said client to communicate with said client, said control channel trans- 
ferring control requests and said data channel transferring data between said server and said client; 

said server monitoring said control channel of said client to determine if said client is sending a 
data request to said server; 

45 said client requesting data by issuing a data request to said server through the control channel, 

said data request identifying a format of digital video data to be transferred to said client; 
upon receipt of said data request, said server responding by; 

allocating a storage means for storing digital video formats; 
extracting said digital video data from said video acquisition means; 
50 converting said digital video data into said format Identified by said client; 

storing said format in said storage means; and 

transferring said format to said client through said data channel of said client until said client 
issues a control signal to said server through the control channel of said client, 

whereby digital video data of said format as specified by said client is transferred from said server 
55 to said client through said computer network. 

2. The method according to daim 1 , wherein said control signal from said client to said server requests sakJ 
server to in a first operative mode cease transferring said digital video data or in a second operative mode 
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to retrieve another format of said digital video data. 

The method according to claim 1, further comprising the steps of: 

said server determining whether said format requested by said client is available in a storage 
means, said storage means storing formats of said digital video data already converted for other clients 
in active connection with said server, and if not available, said server converting said digital video data 
from said video acquisition means into said format specified by said client and storing said fornnat in said 
storage means, said server then transferring said format to said client. 

The method according to claim 3, further comprising the step of: 

if said format requested by said client is already available in said storage means, said server trans- 
ferring said format from said storage means to said client directly. 

In a data communication system comprising a plurality of computers coupled through a computer network, 
video acquisition means coupled to a first computer ("server) for converting video image data from a video 
source into digital video data, a method for providing said digital video data in a plurality of digital data 
formats to a plurality of other computers ("clients"), said method comprising the steps of: 

each client requesting data by sending a connection request to said server through a default com- 
munications channel coupling between said network and said server; 

upon receipt of the connection request, said server responding to each client by establishing a con- 
trol channel and a corresponding data channel dedicated to each client, said control channel transferring 
control requests between said server and each client, said data channel transferring data between said 
server and each client; 

said server monitoring each control channel to determine if any of said clients is sending control 
requests to said server; 

each client requesting data by issuing a data request to said server through the control channel, 
said data request identifying a format of said digital video data to be transferred to each client; 
upon receipt of the data request, said server responding to each client by; 

allocating a storage means for storing said plurality of formats of said digital video data; 
said server extracting said digital video data from said video aquisition means; 
converting said digital video data into formats requested by said clients; 
storing said formats into said storage means; 

transferring said formats to each clientthrough its respective data channels until each client 
issues a control signal to said server through its respective control channel, 
whereby said digital video data in said formats is transferred to said clients. 

The method according to claim 5, when a computer ("new client") coupled to said network not already 
connected to said server with a control channel and a data channel request data to be transferred from 
said data acquisition means, said server already providing data to other clients through their respective 
control channels and data channels, said method further comprising the steps of: 

said new client requesting data by sending its connection request to said server through said de- 
fault channel; 

said server responding by estabiishing a new control channel and a new data channel dedicated 
to said new client; 

said server monitoring said new control channel to determine if said new channel Is sending a data 
request to said server; 

said new client issuing a data request to said server, said server responding by; 

determining whether said format is already requested by other clients in active connection 
with said server, and if so, said server directly transferring said format form said storage means to saW 
new client; 

if said format is not requested by other clients, said server converting said digital video data 
into said format; 

storing said format into said storage means; and 
transferring said format to said new dient through its data channel, 
whereby digital video data of said format as specified by said new client is transferred to said new 

client. 

A network video server system comprising: 
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a plurality of computer systems; 

a computer network coupling a first computer of the piuraiity of computer systems to the other com- 
puter of the plurality of computer systems; 

video acquisition means coupled to said first computer for converting video image data from a video 
source into digital video data; 

server means coupled to said first computer for transferring said digital video data from said video 
acquisition means to the other computer in formats requested by the other computers, said server means 
comprising; 

control channel and data channel control means for establishing a control channel and a cor- 
responding data channel between said server means and each of other computers, said control channel 
means utilized for communications, said data channel means utilized for transferring formats of said digital 
video data, said server means continuing checking control channels for requests from any of said other 
computers; 

data capturing means coupled to said video aquisition means for extracting said digital video 
data after at least one of said other computers is connected to said server means through its control chan- 
nel and data channel; 

data format converting means coupled to said data capturing means for converting said dig- 
ital video data into a piuraiity of formats in response to requests from said other computers; 

client connection means coupled to said data format converting means for transferring said 
formats to said other computers; and 

client means coupled to each of said other computers for sending requests to and receiving re- 
sponses from said server means, said client means utilized for sending a connection request through a 
default channel to said server means, said server means responding by establishing a control channel 
and a data channel for each of said other computers, said client means sending a data request to said 
server means through control channels and receiving data through data channels, 
whereby said server.transfers a plurality of said digital video data to said other computers concurrently. 

The server system according to claim 7, further comprising: 

a storage means coupled to said format converting means for storing said formats such that if a 
requested format from a new computer Is already available In said storage means, said client connection 
means can directly transfer said requested format to said new computer without converting again. 
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